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REPORT ON THE HEW SUMMER INSTITUTE - 1969 


The Bureau of Educational Research and Testing Services; a sub-unit of 


the Department of Education, University of New Hampshire, conducted a 


six week research training institute during the period of July 7 to “a 


August 15, 1969. The grant provided for the training of thirty 


participants fron any of the six New England states. 


This research training institute was funded by the Department of Health, 
Education and Welfare, Reaseech: Teatnien Division. The institute set 
for itself the following set of objectives: 


ds The first major theme was the study of the problems 
inherent in evaluating the particular curriculum 
changes with which the trainee was concerned. The 
study of the problem of evaluation was approached 
by having the trainees identify, write, and evaluate 
objectives for instructional programs in the ared 
of curriculum change in which they were interested. 


Specific objectives: 


At the end of the program the participants demonstrated 
their ability to perform the following tasks: 


a) ' Identify evaluative techniques which can be utilized 
to provide information for making decisions about 
curriculum change. 


bj) Identify the objectives for a specific program in 
their area of interest. 


c) Discriminate between well written and poorly written 7 


objectives, 
d) Identify and construct performance objectives. 


e) To translate (where possible) into performance 
objectives the objectives stated in the curriculum 
guides presently in use in their school systenis 
which are stated in non-verbal terms. 
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of Campbell and Stanley, or the context, input, 


‘advocated as the method of organizing the project, 


_ techniques applicable to nroper implementation of the 


mon 


The second major theme was the study of the major 
alternatives oper. to the educator in terms of 

educational research methodologies, For instance: 
the experimental approach as typified by the work 


process and production (CIPP) model as presented 
by Daniel L, Stufflebeam. In either approach the 
program review and evaluation techniques, (PERT) 
developed for education by Desmond Cook, will be 


Specific Objectives 


At the end of the program the participants demonstrated 
their ability to perform the following tasks: 





a) Identify the classification scheme of the CIPP 
evaluation modei, 


b) Const#uct a research study using either context 
evaluation, input evaluation, process evaluation 
or product evaluation. 


c) . Describe the difference between an experimental 
and a quasi-~experimental design for educational 
research, 
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d) Order, using the PERT technique, the planning of 
an educational research study, 


The third major theme was the study of communications 


decision-making process at various levels of the 
educational systems, 





Specific Objectives 


At the end of the program the participants demonstrated 
their ability to perform the following tasks: 


a). Interpret the research findings of several journal articles. 


b) Demonstrate the competency to apply the findings of a 
research study to one's local school situation. . 


c) Describe the problems associated with dissemination 
and adoption of the general kind of. educational 
research findings to a local school systen.. 
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4, The fourth major theme was the use of whines data processing 
equipment to facilitate the encoding and utilization of 
‘research data, 


Specific Objectives 


At the end of the program the participants demonstrated their 
-ability to perform the following tasks: 





a) Construct a simple computer program, 


b) Identify the problems associated with designing an 
optically scannable document, 


c) Demonstrate the ability to operate a remote terminal, 

qd) Name and describe the use of a variety of modern data 
processing equipment and its utilization in educational 
research, 

5. The fifth major theme was reading of current educational 
literature relevant to the research project with which the 
traine> is involved, 

Specific Objectives 


At the end of the program the participants demonstrated 
their ability to perform the following tasks: 


a) To identify the major reference sources for 
educational research literature, 


b) Construct a bibliography in the area of the trainees’ 
interest, 


c) Distinguish the major components of a piece of well 
written educational research. 


At’the end of the institute each of the participants was given an 
evaluation form in which he was asked to evaluate on a fourrpoint 
scale the attainment by this institute of its specifically stated 
original objectives, A copy of this evaluation will be found in 
Appendix A. A mean was. calculated not only ihn aan specific 
objective but also by a grouping of all the specific objectives into 


a single catagory for each of the five major themes. In general all 





means are in excess of three points, indicating that the participants _# 





feit that the objectives had been well attained at a ranking of 


between good to excellent. 
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OBJECTIVES E':ALUATION 
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At the end of the institute the participants were asked to 
evaluate the extent to which the institute meet its objectives. 
This was done on a four point basis, and reduced in similar 
fashion to the instructor evaluations. (see evaluation form) 
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The geographical distribution of the participants in this institute was 


as’ follows: 


Maine y " 
Vermont | 3 

New Hampshire ; | 21 
Massachusetts 3 

Rhode Tsland 0 
Connecticut (0 


THE PROPOSED LEARNING SEQUENCE 





The institute was conducted'daily from 8:30 A.M, to 4:00 P.M. for six 
weeks, The institute offered credit in two courses. These two courses : 


are described below: 


Education 881, Methods and Techniques of Educational Research. ‘This 
course is a critical study of the principal methods employed in the 
investigation of educatéonal problems and an evaluation of the procedures 
and standards used in reporting the findings; designed as an advanced 
course for Master's Degree candidates. 


Education 882, Research Problems in Education, is concerned with the 
individual investigation of a problem in the area of educational research. 
This course will be used first to expose the trainees to a variety of 
educational research. In the latter portion, each trainee will be 
expected to develop a research proposal which will have practical 
importance and relevance tc his home district, or to evaluate a project 
presently being studied. 


The two courses described above were offered daily between 8:30 A.M, and 
11:45 A.M. The period from 1;00 P.M. through 2:30 P.M, each day was held 


open for individualized consultation and library research, The institute = 
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met each afternoon from 2:30 P.M. through 4:00 P.M. during which time the 


trainees were instructed in the use of the computer as an educational tool. 


The first week was given over to an intensive study of the construction 


, 


of behavioral objectives, the design of assessment tasks, the 


construction of learning sequences and a study of their empirical found- 


ations, Supporting and instructional materials included: The Conditions 


of Learning, Robert M, Gagne; AERA Monograph Series on Curriculum | 


Evaluations; Pre aring Instructional Objectives, by Robert F. Mager; 





Developing Attitude Toward Learning, by Robert F, Mager; a number of audio- 


visual aids such as‘ the Popham fi1m strip series on objectives as well as 
the audio-visual series called, "Why Behavioral Objectives?" The 
participants were also given the following mimeographed handouts: 
Definition of Ten Action Words: Evaluation of Science: a Process 


roach 





; A Hierarchically Based Test Battery for Assessing Scientific 


Inquiry, (Appendix B) 


The chia week of the institute was instructed by Dr, Henry H, Walbesser. 
The primary task of the trainees was to read and complete the paperback 
called, "Constructing Behavioral Objectives" as well as a series of 
thirty-seven tasks which Dr. Walbesser and the Director of the Institute 
had worked out during the spring semester. Dr. Walbesser was assisted by 


two group leaders so that 2 low 1-10 teacher~student ratio could be 


maintained in the small group instruction. 
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The third week of the institute was given over to a study of different 
models for evaluating education, Supporting instructional materials 
included, Experimental and Quasi-Experimental ee for Research, by 
Donald T. Campbell and Julian C. Stanley; Evaluation as. Enlightenment 
for Decision Making by Daniel L, Stufflebeam; Handbook of Research on 
Teaching by Nathaniel Gage: Statistical Analysis in Psychology anc 
Education by Ferguson; Non~Parametric Statistics for the Behavioral 


Sciences by Sidney Siegel, 


The fourth week of the institute was instructed by Dr. Daniel Stufflebeam., 
The learning sequence was worked out with Dr. Stufflebeam during the 
spring semester.''He was assisted in his instruction by three group 
leaders who were trained in the use of the CIPP evaluation’ model, and 


were an aid in the small group instruction. 


The £1f£th week, the first two days were given over to a study of the 
PERT technique in education. The supporting instructional materials 
included: Program Evaluation and Review Technique, Applications in 
Bducation by Desmond L. Cook. The content of that instruction was 
worked int between Dr. Cook and the project director during the spring 
semester. The fifth day of the fifth week, Dr. John Cawley, University 


of Connecticut presented a paper entitled, "Research in Reading and 


_ Psychomoter Disabilities." 


The sixth week, the first two days were given over to a study of the 


problems associated with the development, dissemination and adoption 


(DD§A) processes in education. The third and fourth days were under 
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the instruction of Dr. William Asher, The content’ of those two days was 
Worked out between Dr, Asher and the director of the Institute during the 
spring semester, The fifth day of the sixth week was given over to a 


presentation by Maurice Olivier, The topic was "The Potential of Systems 


f 


Thinking in Education", 


During the first four weeks of the institute, each afternoon between 
2:30 P,M. and 4:00 P.M, the trainees were instructed ‘in the use of the 


computer. They were taught to identify the basic components of it and 


were given an introduction to computer programming. The major emphasis 





of the learning sequence, however, was the demonstration by the trainees 
of mastery of the use of a remote terminal. During the spring semester a 
series of simple statistical programs was written and stored so that the 
institutees could call them out in the memory of the computer. and so 

use them in computational tasks, Therefore, the last two weeks of the 
institute. the trainees were concerted with the use of the computer only 
as a tool in working on their particular problems. The instructor was 
available each afternoon between 2:30 P.M. and 4:00P,M. as a resource 


person to heip them in any way that was necessary. 


A major requirement of the institute was the creation by each trainee 


of a proposed model to evaluate the educational problem which which he 


is involved, 
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The material which has just been presented is what the author of this 
particular proposal originally proposed to do. The question now is, how 
well was it done? In an attempt to assess the adequacy or inadequacy of 
this summer institute, the following assessment tasks were undertaken: A 
lengthy pre-test ani post-test were constructed, The prentest and post 


test consisted of 160 multiple choice items. These questions were in 





general drawn from a test designed by Gene V. Glass which was entitled, 








"Mastery Test Items for Courses in Educational Research Methods". AL 





copy of this pre-test, post-test will be found in Appendix A of this report. 











A complete set of statistics based on both the pre-test and post-test results 











are included immediately after this section. They consist of the following: 








a complete item analysis and item count on each of the questions; the 




















computing of the mean, the standard deviation and the range of scores; 





the transforming of all scores to 2 scores and to standard scores; the 
standard score being based on a mean of 500 and a standard deviation of 
100; a calculation of a frequency distribution as well as cumulative 


percentile based on that frequency distribution. The print-out of the 








individual students! scores included their raw score; their percentile 


rank: their stanine; their standard score and a z score. The mean on the 


'€ 


pre-test was 54.48 with a standard deviation of 17.99. The range was from 





20 through 95 raw score points. The same complete set of statistics was 
calculated on the post-test and this is also found immediately following 
this section. The mean of the post-test was 87.55 with a standard 


deviation of 16.65. The range was from 53.to 117 raw score points. The 
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average gain, then, over the six week period from the pre-test to the post~- 
test was 55.11 score points. This is a very significant gain, Immediately 
following the test analysis will be found a chart which indicates for the 
individuais in the institute the raw point score gain and the percent of 
gain over the six week period. The eer go from a low of a 2 point 


raw score increase to a high of 66 raw score points which is equivalent to 


a 330% gain over the pre-test score. 
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THE CHALLENGE OF ASSESING CURRICULUM CHANGES IN NEW ENGLAND 
POST-TEST ADMINISTERED AUGUST 15,1969 OMET AS A SIXTH CHOICE 


MeAN= 87.552 S$D= 16.653 N= 29 RANGE= 53-117 








SCORE 7 SCO. TR-SCO. FREQ. prt. ONE *# = ] 
104 0.99 598.77 0 79 * 
105 =s-1605 604.77 L 82 « 
106 Lell 619.78 0 83 ‘ 
107 se lL?) «616.78 0 93 * 
198 1623 622.79 ! 86 + 
| 109 =—s-:14.29 628.79 l 90 « 
| 110 1635 634.80 i 93 * 
| 111-1042 640.80 0 93 * 
112-1647 «646.81 0 93 * 
113-1653 652.81 0 93 * 
114 1.59 658.82 1 97 * 
115-1065 664.82 0 97 * 
116 se 71) 670.83 0 97 ‘ 
117 =—s-1e 77?) 676.83 1 100 * 
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THE CHALLENGE MF ASSESING CURRICULUM CHANGES IN NEW ENGLAND — 
OMIT AS.A SIXTH CHOICE 


POST-TEST 


ANMINISTERED 


STUDENT NAME 


FEV ANS 


NORM AN 


MACFARLANE JRJAMES W 


APTT 

PH AUP 
WINSLOW 
POPL AWSK I 
ABBOTT 
HARNOIS 


BARNES 


HOK ANS 


CAMERON 
DIXON 
GRODINSKY 
COGAN 
ROY 
DARLING 
HACKETT 
SIMPSON 
EMILIO 
OSBORNE 
MARSTON 
TOMKINSON 
GRAHAM 
FEUERSTEIN 
LEWIS 
POIRIER 


FREDERS 
PATRK W 
EDWARDF 
FUGENEJ 
DNUG W 
HERM ANA 
EVFRETW 
CORY 8 
PHILP 
RALPH €& 
HARNML DM 
RICHARW 
LUCY A 
SCOTT 
FRANCTID 
VELMA E 
ANN D 
DOUG L 
CHAR H 
LESTE € 
CONR ADV 
MARTIN 
GEORGE 


ROBT 01 


AUGUST 1541969 


SCORE 


95 
87 
67 
6T 

110 
87 

108 
71 


98 


98 


13 
79 
80 
114 


93 


68 
73 
8) 
94 
117 
92 
71 


97 


105 


Th 


ICT «RANK 
66 
55 
10 
10 
93 


55 


86 


24 
T6 
16 
31 
34 


38 


3 
45 
14 
31 
41 
62 

100 
59 


24 


69 


8 3 


24 


97. 


STA STD.SCORE 


6 


5 


2o Nn N 


| So 


p= 


Ww wa FF Ww wi ODO DR HR HP Ww VW 


oF FS FF B® WwW 


545 6 
497. 
377. 
377. 
635. 
497. 
623. 
401. 
563. 
563. 
413. 
449 « 
455. 
659. 
293. 
485. 
383. 
413. 
451. 
539. 
677. 
527. 


401. 


557. 


605. 
401. 





Z~ SCORE 
0.45 
—Qe G3 


~1.23 


~1.23 




















A AL aaah als Dd ee oe EE oot a RE ere fet oe OR me ee. ie en Se ee er eo A ee amet anger ee epte 
° 
e 





THE CHALLENGE OF ASSESING CURRICULUM CHANGES IN NEW ENGLAND 
POST-TEST ADMINISTERED AUGUST 15,1969 -OHIT AS A STXTH CHOIC: 
STUDENT NAME SCORE PCT.RANK STA STOD.SCORE 2~SCGRE 
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GAIN AND PERCENT GAIN BETWEEN RAW SCORES 


NAME 


T= 10295039 


X=traw score, pre test 
Y=raw score, post test 


2 SIGNIFICANCE TEST OF DIFFERENCE BETWEEN MEANS 


GAIN 


The t is significant at the 1% level for 27 degrees of 
freedom, thus the difference between the mean of X and 
the mean of Y is significantly different from zero. 


Tet er peter 


107.692 


Y 
' ABBOTT DOUGLAS 186 LOB. 30-000 
APT FREDERICK 40. 676 2174000 
BARNES EVERETT ~- BD DB mr GL 000 
CAMERON PHILIP 456 136 28.000 
COGAN RICHARD. 106 114.6 — 446000 
DARLING SCOTT 586 85. 272000 
“DEXON RALPH 47 « 19.6 326000 
EMILIO ANN 39. B81. 42.000 
EVANS NORMAN 61. 95. BH eO00 
FEUERSTEIN MARTIN Ie 97 45.000 
GRAHAM CONRAD D1 tls 206000 | 
GRODINSKY HAROLD 666 BO. 14.2000 
HACKETT FRANCES © 4B 686 20900 
HOKANS CORY B54 98 13.900 
LANCE WILLIAM 206 86 66.006 
LEWES GEORGE 4G2e 1056. 636000 
MARSTON CHARLES 67.6 Lite 50.000 
MACFARLANE JAMES 63 « ols 246000 » 
MURDOCK ALLEN 4le 1036 624000 
“OSBORNE DOUGLAS ST e 94» 372000 
POETRIER ROBERT 44 4 Tle 27.000 
POPLAWSKI EUGENE 10.6 87. L7+000 
RICE ROBERT 956 LOD. 14-000 
ROY LUCY ANNA JLe 536 24000 
SIMPSON VELMA 4B. 73. 25.000 
TOMKINSON LESTER 44. 92. 48.000 
WINSLOW EDWARD 90 « 110. 206000 
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A Pearson product correlation was calculated between the pre-test and 
post-test and that correlation turns cut to be .54. The correlation 
coefficient, then indicates that in fact the learning did have a 
differential effect on the participants involved over the six week 


period of time. 


A Spearman rank correlation coefficient was calculated based on the raw 
score obtained on the pre-test and post-test for all institutees. Their 
ranks on the pre and post-test are given as well as the difference in 
rank, either plus or minus. The Spearman rank correlation coefficient 

is .49, indicating again the differential effect on the partiolpante over 
the six week period. A second Spearman rank correlation coefficient 

was computed based on order of finish on the post-test and raw score rank 
on the post-test. This resulted in a correlation coefficient of ~.15, 
indicating very little correlation. A T test shows this correlation to be 


not significantly different from zero at the 10% level. 


A split half reliability coefficient was calculated for both the pre-test 
and the post-test. The reliability of both the pre-test and the post-test 
turned out to be very high. The reliability coefficient for the pre-test 
is .92. The reliability coefficient for the post-test is .92. The 
overall evaluation of the institute then in terms of a pre-test, post-test 
design indicates: that the tests themselves were very reliable; that they 
validly tested the material which was being taught; and that there was 


a very substantial average gain in knowledge over the six week period. 


a 
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At two week intervals the institute and its instructors were evaluated by 
the participants, They were asked to apply a four point scale that went 
a poor to excellent, with NA being not applicable, The calculations 
of the means of each of the eight areas of activity of the institute and 
of the personnel involved in the institute are presented at the end of 


this particular section, 


The mean is calculated not only by category but also by grouping all of 
the categories and coming up with a Single mean for that individual 

across eight areas or activities. In general all ineans are found to-be 
in excess of three points indicating that the personnel associated with 


this institute were doing a good to excellent job, 
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PEARSON PRODUCT MOMENT CORRELATION COEFFICIENT 








X= raw score, pre test 
Y= raw score, post test 
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The correlation coefficient of .545 indicates little correlation, 
with the six weeks having a differential effect on the people in- 


volved. 
six week period. 


Thus the increase can be attributed to learning over, the 
The square of this coefficient, 


292, indicates 


that using either cf the two regression lines as a means of pre- 
diction would produce only 29 % accuracy. 
are: 


26 mG 
i i 


.58Y + 


-50X + 60.09 
2.88 


These regression equations 
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SPEARMAN RANK CORRELATION COEFFICIENT 
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CORRELATION COEFFICIENT= 


T= 2298034 


24.0 


13.0 


18.0 
2745 


16.0 


0497537 


X= rank in class based on pre test raw score 
Y= rank in class based on post test raw score 


D= difference between ranks 


Since the rank was determined by raw score, the correlation 
may be interpreted in the same way as the Pearson Product 
The t shows that the 


Moment Coefficient mentioned earlier. 


correlation is, significantly different from zero at the 1 % 


level. 
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SPEARMAN RANK CORRELATION COEFFICIENT 


NAME xX 
RICE ROBERT 1.0 
WINSLOW EDWARD 2.0 
HOKANS CORY 3.0 
ABBOTT MOUGLAS 4.0 
POPLAWSKI EUGENE 5.5 
COGAN RICHARD 5.5 
MARSTON CHARLES 7.0 
GRODINSKY HAROLD 3.0 
MACFARLANE JAMES 9.0 
EVANS NORMAN 10.0 

“DARLING SCOTT 11.0 
OSBORNE DOUGLAS 12.0 
FEURESTEIN MARTIN 1320 
ROY LUCY ANNA 14.5 
GRAHAM CONRAD 1405 
HACKETT FRANCIS 16.5 
SIMPSON VELMA 16.5 
DIXOM RALPH 18.0 
HARNOIS HERMAN 19.5 
CAMERON PHILIP 1965 
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MARSTON CHARLES 2160 1G 2040 
TOMK INSON LESTER 2200 13.0 940 
GRAHAM CONRAD 2360 24.40 -1.0 
FEURESTEIN MARTIN 24. 10.0 1460 
LEWIS GEORGE 2560) 660 19.40 
POTRIER ROBERT 20060 24.40 260 
MURDOCK ALLEN 27.0 720 2040 
LANCE WILLIAM 28.0 16.0 120 
RICE ROBERT 2920 440 250 


CORRELATION COEFFICIENT= -.150000 


T= ~~. 1/8834 


X= order of finish, post test 


Y= rank in class based on raw score, post test 


D= difference between ranks 


The low negative correlation seems to indcate that what little 
correlation there is may be interpreted as the more time spent 
on the exam, the higher the rank in class. However, the t is 
not significant even at the 10 %.level, and hence the correlat- 
ion is not significantly different from zero. 
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RELIABILITY CORFFICIENT 


The reliability of both the pre-test and che post-test 
was tested by the split halves method. In both tases 
the test was split into raw scores for the even numbered 
questions, and raw scores from the odd numbered questions. 
The correlation between these scores should produce a 
reliability coefficient approaching 1 if the test is rel- 
jable. It is seen that for the pre~test immediately fol- 


lowing, and later for the post-test, this is the case and 
the tests can be assumed reliable. 
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RELTAGILITY COEFFICTENT,PRE TEST 
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RELTABILITY CORFFFICTENT,POST TEST 
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INSTITUTE EVALUATIONS 


At the end of each two week session, the institutees 
were asked to evaluate the presentations of the inst- 
ructors. They were asked to respond to eight categ- 
ories for each person, using a four point scale. (See 
evaluation forms) The results were reduced to means 
for each question, section means for each instructor, 
and total means for the particular two week session. 
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FIRST EVALUATION-JULY 7-JULY 18 


etre twee wee eee em ee ree Ce He es ~~ - “ys tem) ke ~ "s ad oe. tt dm. : ' . 


MEAM( J) 5,64 
mAs ( 4)s 4,55 . 
rEAM( B)s= 3.72 
‘ “EAM ( 4) 3,5] 
KEAN ( B)s Be44 : 
MEAN ( 6) 3.26 
"TEAM ( 7)= 3.17 
weAM( B)s 3,58 
KMiEAM( 9)= 3,14 
MPEAM(CTO)= 2.69 
MEAN (LIL}J= B.09 
fs: eaut ce ta Lae 
FAM (E3)= 44 DY 
: ali Jz 2,14 
MEAM(L5)= 43.414 
MEAN (YTA)s 3,17 ’ 
PEAM(CLT7 )= 3.67 
WEAN (LR )= 39 2F 
ee ian. ba cis 
RAN (20) B44 
WEAN (21) = 3.32 (1-8) Dr.Gilbert Austin 
MEAM( 422 )= B42] 
MiEAN(2Z3)2 3.03 (9-16) Donald Bailey 
MEAN(24)= 3.37 
MEAN (25)= 0.00 (17-24) Dr. Henry Walbesser 
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MEAN(26)= 0,00 
MRAM (2 7)= O.490 


. MAM (28 )= 0.00 
| MEAN (Z9)= 0.06 
MEANM(3O)= 0.00 
MEAN (S1)= 0,00 
mEAM(A2 = O60C 
MEAN (33 )= 0.00 
MWEAN(34)= 0.00 ra 
PRAM (BS )= O.00 
MEAM(SH)= 0600 
MEAN (S7)= O.G0 : ) 
MRAM (S8)= 02400 
MEAM(BY)=s O200 
MEAN (40)= 0.400 
FEAM OF FIRST & 3.491228 
MEAM OF SECOLD & 3.07798) F 


MEAM CF THIKD & 3.331558 
MEAN OF FUURTH & 0.000000 
MEAN OF FIFTH & 0.000000 
TOTAL MEAN 3.303571 
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SECOND EVALUATION-JULY 21~-AUGUST .1 


MEAN (- L)= 3.66 
MEAN ( 2)= 3,62 
meAM( Spe 4,59 
MEAM( 4 )e 23,77 
MRAM ( S)e 3.42 . 
MEAM( 6) 3446 
MEAN( 7) 3o%G 
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MEAN(13)= 2.93 
MEAN (14)= 3.00 
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education evaluation 
- Don Bailey continuation of computer 


programming 


Dr. Desmond Cook PERT and Program 
Management. | 


‘Dr. John Cawley Research Methodology 
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|. Maurice Olivier Systems Approach 


Jim Carr research at the State 
: Depariment level 
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'- Don Randall research at the State 
Department level 
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ii Or. William Asher Development, 
7 Dissemination and : 
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Earlier in this report we have already indicated the proposed learning 
sequence, We will now report the evaluation of each of those proposed 
sequences, The first week was spent in a general familiarization 

process with the ideas and concepts behind stating desived education 
outcomes in the form of behavioral objectives. The canecl week of the’ ~~ 
institute was spent in an intensive work session with Dr. Henry Walbesser 
assisted by Richard Rosen and William some, The schedule for that week's 
work is found immediately following this section, It is not possible 

to repcrt statistically on this particular section as Dr. Walbesser's 
pre-test only tested whether thé behavior was or was not exhibited. It 
was, however, possible to count the number of people in each category that 


exhibited the behavior or did not. Therefore, the following information is 


presezted: 
BEHAVIOR REQUESTED NUMBER EXHIBITING BEHAVIOR 
Name the action verb given a 21 


performance class definition 


Name the hypothesis tested ' 2 
by the adequacy ratio 





Name the least number of ° 
hypotheses of learning 

dependencies needed for a 

learning hierarchy 


Describe the necessary 4 
components of an HLD 


Construct at least two | 24 
performance classes from a 
list of verbs 


Identify statements that | 26 
describe observable per- 
formances | 


















Construct an assessment task 
and the acceptable responses 
for a performance class made 
by the learner 

f, 

Construct an assessment task 
and the acceptable responses 


given the statement of a 


behavioral objective 


Identify and name the six 
components of a behavioral 
objective given in Walbesser's 
definition 


Identify statements which 
satisfy the first three 
components of a behavioral 
objective given ¢ list of 
statements 


Identify cach of the HLD 
given a description of a 
hypothesis 


Construct a behavioral 
objective and an assessment 
task given a non-behavioral 
objective 


Describe two causes for 
rejecting a HLD 


Describe when a behavioral | 
objective and an assessment 
task are in performance 
agreement 


Name two characteristics of an 
‘assessment task 


Describe changes that can be 
made in an assessment task 


Naine the least number of 
action verbs in a 
behavioral objective 


Name two references on 
constructing behavioral 
objectives 


29 


27 


20 


17 


17 
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It is not possible to make any direct comparison between the pre-test 
and the post-test since they were very different tests, It is, however, 
possible to reach the generalized conclusion that the participants learned 


a good deal over this two week intensive period of studying behavioral | 





objectives as judged by the fact that most of them were able to complete 
successfully the first two of the requests on the final test. Many fewer 

did as well on the third and most difficult portion of that final examination. 
The list of the tasks on the pre and post-test and the documentation as to 


their presence or absence will be found in Appendix B. 


s 


As is evident by careful study of the plan for this week there thirty- 
seven (37) tasks that each participant had to complete, A complete copy 
of these thirty-seven (37) tasks and their objectives will be found in 


Appendix B, 


POST-TEST 


-BEEAVIOR REQUESTED NUMBER EXHIBITING BEHAVIOR 


EER EAI BITING BEHAVIOR 
Identify and name all of 

















22 
the HLD given a schematic 
of a learning hierarchy | 

: 

Demonstrate the procedures 16 : | 
for validating a learning 
hierarchy 
Construct explanations ° 


and revisions for those 
hypotheses of learning 
dependency rejected by 
the validation data 





E ERIC 


ie -ationtta 








Schedule: 


Monday 
1, Introduction 
2. Preassessment measure 
3. Meet with consultant in smaller group 
4, Construct small teams 
5. Complete Set A - Tasks 1-5 
6. Seminar for all participants - Learning Hierarchies 


Tuesday 
1. Complete Set B - Tasks 6 - 15 
2. Complete Set C - Tasks 14 - 19 
3, First, second, and third group viewing of TV tape on the 
use of behavioral objectives by new teachers 


Wednesday 
1. Complete Set D - Tasks 20-24 
2. Complete Set E - Tasks 25-29 
3. Seminar for all participants - Hierarchy Validation Ratios 


Thursday 
1, Complete Set F - Tasks 30-33 
2. Complete Set G - Tasks 34-56 


Friday 
1. Complete Set H - Task 37 
2. Seminar for all participants - What Next 
3. Postassessment measure 
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The third week of the institute was spent in an intensive study of ~ 
various methods of evaluating educational research, Particular emphasis 
Was given to the use of context, input, process and product (CIPP) 
evaluation developed by Dr. Daniel Stufflebeam of Ohio State University. 
The participants were also exposed to and studied intensively the book 


Designs for Research, The material that the participants in this institute 


authored by Campbell and Stanley known as Experimental and Quasi-Experimental 





were asked to read and study during this particular two week period of 


time will be found in Appendix C and is listed below: 


"Evaluation as Enlightenment for Decision-Making" 
Daniel. L. Stuff<Lebeam 


"Process Approach in BLoLogy Instruction" 
Kurtz, Edinger, Perko and Murray 


"Context Evatuation of Instauction in Local Schook Districts" 
Robert Hammond 


"The Countenance of Educational Evatuation" 


"Evakuation at the Local Levee" 
Dr. Robert L. Hammond 


_ The fourth week of the institute was given over to an intensive study of . 


the use of the CIPP model in educational evaluation. This week was 
conducted by Dr, Daniel Stufflebeam and three assistants from Ohio State. 
University, Their names: Bernard Barbadora, Michael Hock and William 
Spain. The participants in the institute were given a pre-test and a 
post-test designed by Dr. Stufflebeam and his assistants. Dr. Stufflebeam 


and his staff have prepared a product evaluation of their one week 


participation in this institute. It will be found immediately following 
this section, | | 

As careful study of the master schedule of events will indicate the 
participants had a very bees week. A great deal of time was spent 
working on a simulation exercise entitled, "Simulated Local School 
Evaluation: Materials for a Training Institute in Evaluation", 

created by Blaine R. Worthen and Michael D. Hock. There are no 


available copies of this manuscript. 
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In an effort to summarize, describe, and assess the impact of the recent 


Evaluation Institute conducted at the University of New Hampshire the following 


report has been prepared, 


In response to the question: Has your Wnderstanding of evaluation been 


considerably broadened as a result of the Institute activities and experiences? 


All of the participants responded affirmatively. 


Concerning our inquiry relating iv the participants general reaction as to 


how they would best describe the Institute, the following statistics were obtained: 


| out of 29 of the participants 
| out of 29 of the participants 
2 out of 29 of the participants 


25 out of 29 of the participants 


responded 
responded 
responded 


responded 


i 


¢ 


Very Unfavorable 
Neutral 
Slightly Favorable 


Very Favorable 


Relating to the questions: How relevant the Evaluation Institute was to 


the participant's background, problems, and needs: 


1 out of 29 of the participants 


3 out of 29 of the participants 


25 out of 29 of the participants 


responded 


responded 


responded 


The information generated by the 
institute was too difficult to «7°. 
stand and to be able to benefit from 
the information. } 


! understand almost everything, but 
the Institute didn't help me solve 
my most important problems or meet 
my basic needs. 


The Evaluation Institute dealt with 
my problems and needs in an un@:. 
standable and Interesting way. 
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|. In trying to arrive at some descriptive evaluation data as to how 
well the Evaluation Institute achieved its basic objectives, the fol low- 


ing figures were obtained: 
OBJECTIVE WL 

To en the participams be able to identify the various stages 
of the CIPP Evaluation Mode}, and appiy these Stages in various task 
situations In a given simulated evaluation problem, The participants! 
understanding <f the various stages will be determined in terms of an 
oral and written response to each task in the simulation and by an | 
Institute reaction scale. 

The results of the data indicatad that twenty~five out of twenty~ 
nine of the participants, as determined by their responses and the 
Institise reaction scale, were able to identify, and be aware of the 
problems and limitations In the various stages of CIPP Evaluation. 

A total of two participants seemed to be uncertain about identifying 
the various stages, and the remaining two participants attained a smal} 
fraction of success in terms of identifying and becoming aware of the 
problems or limitations of the varfous stages of CIPP. 

OBJECTIVE If 

The total group mean gain of the participants, in terms of in= 
creased knowledge about the realm of CIPP Evaluation, will shift to a 
higher mean as determined by the results of an evaluation achievement | 


examination. * 


*Statistical results in terms of attaining the last two objectives can 
be found in the data summary contained in the report. 


! 














‘The participants attitudes (receiving, responding, valuing, 
characterizing, and organizing) will be more favorable as a result 
of the Inst Itute as determined by an attitude scale administered on 
@ pre and post test basis. * 


Due ts the fact that in ss acta of participants one person 


* % 
- 
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- aks 
= Z ris oe 
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arrivad late, his attitude scale had to be eliminated from the post 
test analysis. Therefore, .N = 28 on the attitude survey. 
ATILTUDE SCALE 


in respect to the attitude instrument, the five point Likert 


‘Scale was used to determine participants performance. The scale has 


@ range of from one to five points with the weight one representing 


= 
Sn aR eT ST Te ERR EL “rater ee oot . 


a definite negative rating, to the weight of five which is the most 
positive. Each item on the test is individually rated and then a total 
score Is computed by summarizing each particular item. . (Total score 
on this particular test could have ranged from 34 ~ least positive to 
170 ~ most positive.) By dividing the total score by the number of 
| Tams on the particular test, the resulting. score will then fall along a 
the five point continuum. | 
With this basic Information in mind, and using the criteria 


- established by the Likert Scale, the fol lowing characteristics were 


- 
. 
a 
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a 


evident in statistically AORROETES: and 1 contrasting the pre and post _ 
test attituie scale: — | 

stitial tn terms of attaining the last two objectives can 
‘be. found in the data suqmary contained in the report. 


+0. Krech, 0. Crutchfield, and &. L. Ballachey. Jodividual_and Society. 
7” New York: McGraw-Hilt Book Co., 1963. Baer Chapter 5). 
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; Pre Test Number of Examinees n= 28 | 

* Post Test Number of Examinees | n= | 28 | 

Number of Items on the Pre Test — = 3h | | 
Number of Items on the Post Test . = 3h | 
Avergge Total Score of the Pre Test = 135.46 | 
Mean Iten Score for the Group = 3,92 . , 
Average Total Score for the Post Test = 142,04 | , 
Mean item Score for the Group es 81g | | 
“Pre Test Standard Deviation '¢g - 15.77 | : 
: Post Test Standard Deviation | om 11.94) : q 
Varlance of the Pre Test = 248,61 : 
| - Vartance of the Post Test . : 148,26 | 
in respect to the Evaluation Achievement Examination, certain | 
“points wilt now be emphas ized in order to enable the reader to more | | 
| clearly analyze the statistical data that were generated through the | | 
7 utilization of the instrument. : 
od The range of possible scores could have extended from 0 to 30. I 
, 2. The complete test was objective in nature. ae 1 
3s Correct answers were assigned a weight of one. 7 ] 
~&. On both examtnet tons N= 29, 4 


5. The examination was administered on a pre and post test basis. 
| 6. Names ian not included, SO, an error ieee nau not be computed, 
and.a significance test between pre and post test ineans could 
rot be calculated. - 


| 





Then, in terms of a statistical comparison and contrast between 


‘the pre and past test 


characteristics were evident: 





» the following 


Pre Test Humber of Exam inees es ne 29 
Post Test Number of Examinees | n™ “a9 
Number of ltoms on une Pree Test 7. | = 30 

| Number of Items ‘on the | East Tost 2 = 30 
Pre Test Mean | ~ 12.86 
Post Test Mean | oe mm 16631 

"Pre Test Standard Deviation oo am 3,38 ; 

Post Test Standard Deviation 7 - om 2,3) 
‘Pre Test Range of Scores. | 7 ~ 19 = 12, 

: » Post Test — of Scores a 12+ 20 = 8 
| - Pre Test Median | = 12.50 
: 5 : Post Test. Median * 16.50 


7 ‘Ere Test Mode | 7 a a = 14 
; “Past Test Mode | | 








=s VW 
Variance of the Pre Test = 11,42 
Vartance of the Post Test = 5035 , 
p . . » 
. - 














ot 


In summarizing these two sets of data, it could be stated that the ' 
participants attitude toward the realm of educational evaluation definitely f 
‘Imcreased. Specificaily, there was a 6.58 point gain of total score on ] 
the post test, a, an 


With respect to the Evaluation Achievement Examination, the results 


can be summarized by stating: that the mean, median, and mode, al} 
' | « 


increased in post testing, while the standard deviation was lowered, 
Specifically, there was a group mean gain in the achlevement scores 
from pre testing to post testing of 3.45 points. . 
Thus, as a resuit of the data obtained from our week long Evaluation 
Institute we are lead to conclude that the institute had a favorable 


impact on the participants both in terns of making their attitudes more 


favorable toward evaluation, and increasing their knowledge about evaluation. 














DATA SUMMARY. 


on 


Pre and Post Test 


EVALUATION ACHIEVEMENT EXAMINATION 
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score 


| x fx " y! (x'4) 


— 


a 


19 


18 
17 
16 
15 
14 
13 
12 
HW 
10 


M = Assumed Mean + fx! 
N 


M= 13 + <4 


Mean = 12.86 
Mode = 14 

Range = 7-19 = 12 
Median = 13.50 

C = 3.38 


Variance = 11.4) 
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PRE TEST 
STATISTICAL DATA 
EVALUATION ACHIEVEMENT EXAMINATION 
NEW HAMPSHIRE INSTITUTE 


£ 
VU 


ia? 


25 
36 


N(zfx') - (s fxt)2 
o = N (N= ] 

f 29(320) - (-&)2 
i 29 (29-1) 


> en ee 


F(x! 2 


26 
50° 
32 


97 


4 
5 
0 
2 
12 
27 
64 


25 
38 


320 











POST TEST - 
STATISTICAL DATA 
EVALUATION ACHIEVEMENT EXAMINATION 

: NEW HAMPSHIRE INSTITUTE : 


| — XX Score f x! fx! x 2 f (x'2) 


: 20 3 4 16 48 
| 92 6 g 18 
18 h 2 8 k 16 
PB 8 er: 

Assumed 016 3 0 0 0 0 

15 3 =| =6 l 3 

1h 2 -2 “bh l 8 

13 1 33 23 9 9 

12 3 4 -12 16 48 


N = 29 9 158 


M = Assumed 4 Hoan + fe 


M = 16 + 7 = 16.31 
a 
Mean = 16.31 


Mode = 17 N@&fx'4) = (Fx')2 
| o= ON (NeT} | 


" | Range = 12-20 = 8 

a _ / 29(158) - (9)2 = 2,36 
| . | Median = 16.69 o* Sea 

PO o = 2,36 | | : 
i Variance = 5,54 | 


a 
H 
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The last two weeks of the institute were given over to two-day and one-day 
sninars directed by visiting consultants. The alternate days were 

filled in with discussion with the director of the institute, in an attempt 
to pull together the material that was being presented .on the part of the 
consultants, It was not possible to create any pre-test or post-test for 
these short two-day seminars, but the consultants were evaluated, as we 
have already indicated, on evaluation forms at the end of the two week period. 
Dr. Desmond Cook of Ohio State University was a consultant for two days. 
The topic of his discussion was "Educational Program Management" and - 

PERT as a tool within that management concept. Dr. Cook had a very lengthy 
and well developed overhead transparency presentation and the 

interaction with the institute trainees seemed to be excellent. For two 
days previous to Dr. Cook's attendance at the institute the trainees had 


been required to read the book he had authored entitled, "Program 


Evaluation and Review Technique’ and "A Generalized Project Management System 


Model", Immediately following this section you will find the outline that Dr. 


Cook presented in his discussion with the participants over the twe days he 


was here. 


Dr. John Cawley fi. the University of Connecticut came for a one-day seminar 
in which he discussed the problems associated with conducting educational — 
vesearch in a school situation. Particular area of concentration was his 


research in psychomoter difficulties in the area of reading. 
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Educational Program Management Center 
educational Develomnent Faculty 
Coliiede of Education 
The Ohio State University 
. Columbus, Ohio 43210 
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| Sutline for Proj ec eck Management Presentation 
Me oC eerRL SPE, Joo tl beer OP vit tnd ot ete lie at actil tgs Steep pared 44m Lad peavenrt: ee 
he i. Why Project Manage: in € For’ 

, y ject Management in Education? 

| 

_— “yi . ys a % Lg 

r li. The Nature of Project Management 


A. Project Characteristics 





6. Management Functions and Processes 


C. Managenent Systems 


hi. Generalized Project Management Model 
A. Planning Systems 
|, Project Definition 


2, Work Flow 





5. Time 


sStimation 

- echeduling and Resource Allocation 
5 Cost Estimating and Budget 

8. Control System 
i. Reports 
2. Management Actions 


3.  tmplementation and Recycling 
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A179: 


Mr. Maurice Olivier made a one-day presentation on the subject of "Systems 
Thin king. Systems’ Analysis and Its Implications for Education". The 


participants were asked to read in preparation for this ere the 


rr 


booklet entitled, “What is the Systems Approach and What's in it for 


Administrators". A copy of this pamphlet will be found in Appendix E of 


this report. 


One day of the institute was given over to a presentation by personnel 
from the New Hampshire State Department 2f Education: Dr. Donald Randall, 
consultant for research and testing and James Carr, consultant for 
guidance and counseling, Their general topic was, "The Implications of 
Research Based on the Results of Five Statewide Testing Programs in the 


state of New Hampshire, at Grades 2, 4, 6, 8 and 10". 


The final consultant available to the summer research institute was Dr. 
William Asher from Purdue University. The topic of his presentation was 
Development, Dissemination and Adoption", a copy of wiich will be found 
in Appendix F. Dr. Asher spent the first day of his presentation in 
discussing with the participants the problems associated with development, 
dissemination and adoption of educational research findings to actual 

and practical application on the part of educators dealing with students. 
The second day of Dr. Asher's presentation was spent in acting as a 
consultant to the individual participants and reviewing their proposals 
and making critical comments based on them. You will find the general 


outline of Dr. Asher's topic immediately following this section. 
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In Appendix F of this report you will find a paper entitled, "The 
Ingredients of a Research Proposal" which was given to the participants 
#5 8 guide for their preparation of a terminal project which was 
required of all of them. The titles of each of the participants’ 


projects will be found immediately following this page. 


During the ertire period of the institute the participants were taught 
Statistics that weve appropriate and necessary for their use. This 
task was done by Carl Kleiner, a work-study student, majoring in 
mathematics ,assigned to the Bureau. He had worked closely with the 
director in planning this institute. Selected statistics were taught 
from the Following texts: 


“Statistical Analysis in Psychology and Education" 
by George A, Ferguson 


“Non-parametric Statistics" 
by Sidney Siegel 
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This report so far has deait only with the activities which took place in 
the morning and in some cases the first part of the afternoon and in 

‘the evening, The institute had as part of its peopesed’ tenining exposure 
to the problems associated with running a computer and writing computer 


programs. The following is a description of what took place in this 


institute in terms of computer programming. 


First week: At the first class meeting, each member of the Institute was 
asked to write a brief description uf his previous experience with 
computers, if any. One person was very familiar with the Dartmouth 
computer and had worked with one of its remote terminals in his school 

( Concord), Several members of the Institute had made brief visits to 
computation centers, but the seas majority of the class had not even seen 
a computer, On the basis of this information, it was decided that the 


instruction would start at the most elementary level. 


The objectives of the class were stated at the first meeting: that each 
member of the institute would become familiar with the FORTRAN language 
and write a successful conputer program to do some type of data eduction 
which would be useful in his school system. The computer program was to 
be related to the research which the member was doing for his individual 
project if the research project was one which required data reduction. | 
If a research project did not require data reduction, the student was 
allowed to write a computer program of comparable difficulty to others 


being done for the class. 











The instructional portion of - class was begun with a general description 
Of what a ene is, what it can and cannot do, and how it may be used 
as a useful tool in high school testing and instruction as well as in other 
fields. A simplified description of the internal workings of the computer 
was presented, and various types of input/output devices were discussed. 
Each student received instruction in the. use of a keypunch and punched 

his name as an assignment. Relevant readings. in Chapter 1 of "A Guide 


to Fortran Programming'"', were assigned. 


A simple FORTRAN program to read, punch and print a list of names was 
presented in class. A step-by-step relationship between the FORTRAN program 


and the computer steps executed as a result of the FORTRAN instruction was 


discussed at great length, 


At the first possible opportunity, the class was taken to see the IBM 
1620 computer system at the University. This computer system is small, 
and relatively easy to use in demonstrating the operation of computers 
“in general. This "first~hand" look at a computer system gave the 
students the opportunity to see what the equipment being discussed in 
class looked like physically. It also demonstrated the operation of the 
computer and its peripheral equipment as a system. Each student had 
keypunched his name on a card, and these cards were collected at the 
beginning of the demonstration. At the conclusion of the demonstration, 
the cards were listed using the program presented in class to demonstrate 
the usefulness and speed of the computer system in preparing a class 
roster. An error was introduced into the program to demonstrate the 


error-detecting capability of the FORTRAN compiler. 











& 
to demonstrate their usefulness. Students were asked to prepare a flow 
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Second Week: The computer program which was used in the first week's 
demonstration was reviewed, and questions about the computer system 
were answered, The purposes of the FORTRAN compiler program and 
subroutines were also discussed. This discussion was followed by a 
discussion of the corresponding processés of the TBM 360 computer 
system and its associated remote terminals. Each student was asked to 
punch a modified version of the eee ee program and run 
it with his own data on the 360 computer system. The proper job control 
cards were provided for each student, and a visit was made to the 360° 
area of the Computer Center in order to explain the steps in preparing a 


job for this machine. 


The remainder of this week was used for discussing other types of FORTRAN 
statements and constants and variables used in FORTRAN programs. Chapters 


2 and 3 and part of Chapter 4 were assigned in the text. 
Third Week: Flow diagrams were presented, and several examples were used 


diagram for computing the mean and standard deviation of a set of test 
scores, A standard solution to the problem was discussed at the next 
class meeting. Each student was then asked to write a FORTRAN program 
from the flow diagram and run the program with actual data on the 360 
System. A similar assignment was made for the computation of a 
Pearson-product moment correlation coefficient. These statistical 
programs were related to material which had been presented in other 


portions of the institute, 
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Fourth Week: Subscripted variables, including table look-ups, do-loops, 

a the DIMENSION statement were discussed, Addition and multiplication 

‘of array elements were presented and related assignments were given from the 
text. A program for finding the largest element in an array was presented 


and an assignment to find the range of a set of scores using the basic concepts 


of this program was given, Reading assignments were given from Chapter 5 


and 6 in the text. 


Fifth and Sixth Weeks:. No formal classes were held. Each student was to 
work on his computer program with the instructor and other personnel from 

the Bureau of Educational Research and Testing Services acting as consultants. 
The major emphasis of these last two weeks was on the participants using the 
remote terminal to the IBM 360 as they worked on their own projects. All 

of. the students appeared to take the computer project very seriously, and 

_ many’ of them made repeated visits to the Bureau to discuss failures or 
successes of their programs, Each Student fulfilled the requirement for 

the computer part of the institute, and many expressed the feeling that this 
experience would be very usoful to them when. they returned to their schogls 


in the fall. 


immediately following is a list of Computer Programs done by the parvicipants 


of the institute, 


The computer’ portion of this institute was conducted by Donald Bailey, 


a Computer Programmer for .the Bureau of Educational Research and Testing 
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PROGRAM TO COMPUTE MEAN, STANDARD DEVIATION, CORRELATION COEFFICIENT, AND 
COEFFICIENT OF VARIATION 
Corny Hokans 


A PROGRAM TO COMPUTE MEANS, STANDARD DEVIATION AND STANDARD ERROR OF 
DIFFERENCE OF X AND Y SCORES : 
Charles H. Marston 


A PROGRAM TO COMPUTE STANINES 
Velma E. Simpson 


CORRELATIONS OF IQ AND OR Enero SCORES 
Noxman Evans 


SOCIAL. STUDIES CURRICULUM EVALUATION GF MERRIMACK VALLEY SCHOOL DISTRICT 
Martin Feucns tein 


STANDARD DEVIATION, MEAN AND MODE OF TWO GROUPS OF SCORES 
Herman Harnots 


PROGRAM TO PRINS COUNSELOR, DATE AND TIME FOR DAILY ACTIVITIES OF A 
COUNSELOR AND TO KEEP A RUNNING TALLY OF THE TIME IN EACH Roanware 
Scott Darling 


| PROGRAM TO COMPUTE CORRELATION COEFFICIENT BETWEEN TWO VARIABLES 


Ann Emilio 


: MEAN, , STANDARD DEVIATION AND CORRELATION COEFFICIENT OF VARIOUS SCORES 


wiktiam W. Lance 


PROGRAM TO USE WITH BI-LINGUAL SURVEY FOR BERLIN AREA 
Comtad Grahan 


A PROGRAM TO SHOW THE CORRELATION COEFFICIENT BETWEEN THE SCORES ON THE 
CALIFORNIA READING TEST AND THE STANFORD ACHIEVEMENT TEST 
Leé Tomkins on 














COMPUTATION OF THE MEAN, STANDARD DEVIATION, CORRELATION COEFFICIENT, AND 
STANDARD SCORE ON A TES T THAT WAS ADMINISTERED TO STUDENTS AND TO COMPARE 
THESE RESULTS WITH THE NATIONAL NORM FOUND IN THE MANUAL OF THE STANDARDIZED 
READING SURVEY 

Sister Lucy Anna Roy 


PROGRAM TO SHOW THE EFFECT OF PLACEMENT INA TRANSITIONAL CLASS ON CHILDREN © 
ENTERING THE FIRST GRADE AT SOUTH SCHOOL, oe are MASSACHUSETTS 
Richard W, Cogan 


PROPOSAL TO EVALUATE OUR SCHOOL'S READING, GRADES 1-3 
James MacFarlane | 


PLOTTING AND FLOW CHART ANALYSIS 
Edward Wanslow 


PROGRAM TO COMPUTE MEANS, STANDARD DEVIATION, CORRELATION COEFFICIENT, 
REGRESSION LINE OF TWO VARIABLES 
Douglas Abbott 


| PROGRAM TO LIST PHYSICS TEACHERS IN MAINE AND GET AVERAGE COST OF COURSE 
STATEWIDE AND BY TOWN 
Harold Grodinsky 


PROGRAM TO COMPUTE STANDARD DEVIATION 
Francis Hackett 


A PROGRAM TO GRADE STUDENTS 
Pat Phaup 


PROGRAM FOR CALCULATING MEAN AND CORRELATION COEFFICIENT OF N SCORES 
Dougtas 04 borne 


PROGRAM FOR PRINTOUT OF STUDENT NAME, 1Q, PRE-TEST, POST-TEST, ACHIEVEMENT 
AND CORRELATION COEFFICIENT FOR IQ AND ACHIEVEMENT TEST 
Gene Poplaws ki 
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PROGRAM TO COMPUTE MEAN, STANDARD DEVIATION AND CORRELATION COEFFICIENT 
AZ Murdock 


PROGRAM FOR EVALUATION OF PROJECT HEAD START 
Faederick Apt 


PROGRAM TO COMPUTE GRADE POINT a 
Robert 0. Pointer 


PROGRAM TO FIND THE MEAN, STANDARD DEVIATION, AND CORRELATION COEFFICIENT 
Phi Cameron 


A PROGRAM TO FIND THE eee COEFFICIENT BETWEEN TWO VARIABLES 
Robert E, ae 


PROGRAM WHICH SCRTED PRE~TEST DATA, COMPUTED MEAN, STANDARD DEVIATION 
RANGE AND CORRELATION COEFFICIENT 
George Lewes - 


PROGRAM FOR COMPUTING CORRELATION COEFFICIENT BETWEEN IQ AND VOCABULARY 
FOR GRADE TWO 


Everett Barnes Jn, 


| PROGRAM FOR COMPUTATION OF STAY JARD DEVIATION AND CORRELATION COEFFICIENT 
OF ACHIEVEMENT TEST 
— Rakph Dixon — 
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CONCLUSION 


This report has taken the form of an evaluation. The specific format of 


that evaluation is the CIPP model. 


Context Evaluation 

The information presented in the first part of this report is a context 
evaluation. It defines the needs for cad winmeatiaed plan for the running 
of the institute, it identifies the place it will be conducted, and in 


general specifies the types of people who will be invited to attend it. 


Input Evaluation 


The second phase of this report is an input evaluation in which the author 
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documents the various inputs which were available to the participants of 
this particular institute. These inputs took the form of presented 
material, by both the director of the institute and visiting lecturers, 


—— 


as well as a very heavy schedule of reading materials to be studied on 


the participants' own time. 


Process Evaluation 

It is hoped that this report documents very specifically and in behaviorally 
expressed objectives just what it was that the institute director planned 
to have happen to the participants. The entire institute itself was laid 


out in the form of a PERT chart so that there was a maximum concern with 





the interfacing of one particular section of this institute with those 
which preceded it and those which followed it. Therefore, it was 


possibie to evaluate the progress of the participants and modify the 
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program to meet their expressed and observed needs. 


Product Evaluation 


hip ermeeennmreeme mre 


The many pre-test, post-test situations which have already been discussed 
in this report, I think, justify the fact that it achieved the specific 
objectives that it set out for itself.’ On the basis of these four 
evntuations ~ context, input, process and product-it is the feeling of 
the author that he "practiced what he preached". It is the author's 


general feeling that this was a very successful summer research institute. 
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